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D , Abstract. We prove that two-way probabilistic and quantum finite automata (2PFA's and 2QFA's) 

' can be considerably more concise than both their one-way versions (IPFA's and IQFA's), and two-way 

nondeterministic finite automata (2NFA's). For this purpose, we demonstrate several infinite families of 
, regular languages which can be recognized with some fixed probability greater than i by just tuning the 

transition amplitudes of a 2QFA (and, in one case, a 2PFA) with a constant number of states, whereas 
the sizes of the corresponding IPFA's, IQFA's and 2NFA's grow without bound. We also show that 
. 2QFA's with mixed states can support highly efficient probability amplification. The weakest known 

model of computation where quantum computers recognize more languages with bounded error than 
their classical counterparts is introduced. 
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1 Introduction 

In recent years, the research effort on quantum versions of finite automata has mainly focused on one- 
. way models, with the study of two-way quantum finite automata (2QFA's), which are synonymous 

I with constant space quantum Turing machines, receiving relatively less attention. In their seminal 

• ■ paper, Kondacs and Watrous |KW97j proved that 2QFA's recognize all regular languages with zero 

, error, and the language L(,q = {a"6"' | n > 0} with any desired error bound e > 0, in time 0(i|i(;|), 

On . using states, where w is the input string. Since two-way probabilistic finite automata 

' (2PFA's) can decide L^q only in exponential time |Fre81|KF90|DS92] . this established the superiority 

of 2QFA's over 2PFA's. Parallelling work by Aharonov et al. [AKN98j on quantum circuits with 
^ . mixed states, Ambainis and Watrous |AW02j introduced an alternative model, the two-way finite 

^ I automaton with quantum and classical states (2QCFA), which includes a constant-size quantum part 

which may be in a mixed state, but requires the tape head position to be classical. Yakaryilmaz 
and Say |YS09aj noted that conventional methods of probability amplification give significantly 
inefficient results when applied to 2QFA's, and presented methods which can be used to decide Lf,g 
with error bound e in as low as 0(|tt;|) steps (i.e. with runtime independent of e), and with as low 
as 0(log^(i) loglog(i)) states. 

Issues of succinctness, as exemplified above, constitute a rich subtopic of automata theory 
|DS90IKF90IAF98IMPP01IANTSV02IFOM09IYS09a] . In this paper, we examine how the combi- 
nation of two-wayness and (quantum or classical) probabilistic transitions affects succinctness. As 
our main result, we demonstrate several infinite families of regular languages which can be recog- 
nized with some fixed probability greater than ^ by just tuning the transition amplitudes of a 2QFA 
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(and, in one case, a 2PFA) with a constant number of states, whereas the sizes of the corresponding 
one-way machines, and two-way nondeterministic finite automata (2NFA's) grow without bound. 

The Kondacs-Watrous model of quantum finite automaton (to be called, from now on, KWQFA), 
which allows measurements of a restricted type, rather than the full set sanctioned by quantum 
theory, has been proven to be weaker in terms of language recognition power |KW97j . probability 
amplification capability [AF98| . and, in some cases at least, succinctness jANTSV02j . than the 
corresponding classical model, in the one-way case. More general models, such as the 2QCFA, 
employing mixed states, are able to simulate the corresponding classical probabilistic automata 
efficiently in both the one-way and two-way settings, and to recognize some languages that 2PFA's 
cannot |AW02j . We show that 2QFA's with mixed states can support highly efficient probability 
amplification, surpassing the best known methods for 2KWQFA's recognizing these languages. 

We introduce a new model of quantum automaton, named the two-way quantum finite automa- 
ton with reset. This is an enhancement to the 2KWQFA, endowing it with the capability of resetting 
the position of the tape head to the left end of the tape in a single move during the computation. 
We use this model both in the proof of our main result, and in the demonstration of our probability 
amplification techniques. We mostly focus on a restricted form of these machines, called the one-way 
quantum finite automaton with restart (IQFA^), which can switch only to the initial state during 
left resets, and cannot perform single-step left or stationary moves. We give evidence that this is 
the weakest known model of computation where quantum computers recognize more languages with 
bounded error than their classical counterparts. 

The rest of this paper is structured as follows: Section 2 contains the definitions and some basic 
facts about our new model that will be used throughout the paper. In Section 3, we prove some 
key lemmata about the relationship between one-way quantum finite automata with and without 
restart, and examine the class of languages recognized with bounded error by IQFA^'s. Our main 
succinctness result is presented in Section 4. In Section 5, we present several algorithms that improve 
previous results about the efficiency of probability amplification in 2KWQFA's and 2QCFA's. In 
Section 6, we investigate the computational power of probabilistic finite automata with restart. 
Section 7 is a conclusion. 

2 Preliminaries 

Watrous |Wat97j notes that a 2KWQFA algorithm he presents for recognizing a nonregular language 
is remarkably costly in terms of probability amplification, and states that this problem stems from 
the fact that 2KWQFA's cannot "reset" themselves during execution to repeatedly carry out the 
same computation. The 2QCFA model provides one way of solving this problem, by having a classical 
part, in addition to the quantum register. We present an alternative 2QFA model, employing only 
quantum states, whose only difference from the 2KWQFA is the existence of an additional "reset 
move" in its repertory. Section 2.1 contains the definitions of this and the other models that will 
be examined in the paper. Section 2.2 describes some facts which will make the analyses of the 
algorithms in later sections easier. 

2.1 Definitions 

Let U be an input alphabet, not containing the end-marker symbols $ and $, and let F = EU {(t, $} 
be the tape alphabet. 



A 2-way quantum finite automaton with reset (2QFA'^) is a 7-tuple 

M = {Q, Z!,6, qo, Qacc, Qrej,Qreset = ^qeQno,^Qq^) ^ (1) 

where 

1. Q = {qo, . . . , qn} is the finite set of states; 

2. 6 is the transition function, described below; 

3. qo & Q is the initial state; 

4. Qacc is the set of accepting states; 

5. Qrej is the set of rejecting states; 

6. Qnon = Q \ {Qacc U Qrej U Qreset) IS the Set of nonhalting and nonresetting states; 

7. Qreset IS the union of disjoint reset sets, i.e., each Q'^q^^^ contains reset states that cause the 
computation to restart with state q, as described below. 

We assume that the states in Qnon have smaller indices than other members of Q; qi £ Qnon for 

< i < \Qnon\- 

The configurations of a 2QFA'^ are pairs of the form (state, head position). Initially, the head 
is on the left end-marker and so the machine starts computation in the superposition I^OjO). 

The transition function of a 2QFA~^ working on an input string w £ U* , (that is, a tape 
containing w = <tw$,) is required to induce a unitary operator Ug' on the Hilbert space i2{Q x ^|w|)) 
since quantum machines can exist in superpositions of more than one configuration. 

In all 2QFA^'s described in this paper, every transition entering the same state involves the tape 
head moving in the same direction (left, right, or stationary). With this simplification, considering 
the Hilbert space i2{Q), a syntactically correct 2QFA'^ (that is, one where Ug' is unitary for every 
w,) can be specified easily by just providing a unitary operator Uo- : i2{Q) ^2{Q) for each symbol 
a £ r. More formally, 

S{q,CT,q',d^>) = {q'\[]^\q) (2) 

is the amplitude with which the machine currently in state q and scanning symbol a will jump to 
state q and move the head in direction d^/. Here, d^i G {—1,0, 1} is the direction of the tape head 

determined by q . For the remaining directions, all transitions with target q have amplitude zero. 

Apart from the left reset capability, 2QFA~^'s are identical to 2KWQFA's. In the following, we 
focus on this new capability, and refer the reader to [KW97j for detailed coverage of the technical 
properties of 2KWQFA's. 

In each step of its execution, a 2QFA^ undergoes two linear operations: The first one is a unitary 
transformation of the current superposition according to 5, and the second one is a measurement. 
The observable describing this measurement process is designed so that the outcome of any obser- 
vation is one of "accept", "reject", "continue without resetting", or "reset with state q" , for any 

1 £ Qnon- Formally, we use the observable O, corresponding to the decomposition 

E = Eacc © Erej © Enon © Ereset-Q © Ereset-1 © • • • © -E'reset-(fc-l) ) (3) 

where k = | Qnon. I, and for a given input w, 

1. the set of all configurations of the 2QFA'^ is Q x Z^^^; 

2. E = span{|c) \ c€ Q x Z\^\}; 

3. Eacc = Span{|c) | C G Qacc X Z|w|}; 

4. Erej = span{|c) | C G Qrej X Z|^|}; 



5. Enon = Span{|c) | C e Qnon X ^|w|}; 

6. Ereset-i = span{|c) I c G Q^gQ,^^,^ X Z|^|} {Q <i <k - I). 

The probability of each outcome is determined by the amphtudes of the relevant configurations in 
the present superposition. The contribution of each configuration to this probability is the modulus 
squared of its amplitude. For instance, the outcome "reset with state gj" will be measured with 
probability YIc&q^x'L^ | Wc\^^ where Oc is the amplitude of configuration c. If "accept" or "reject" is 
measured, the computation halts. If "continue without resetting" is measured, the machine continues 
running from a superposition of the nonhalting and nonresetting configurations, obtained by normal- 
izing the projection of the superposition before the measurement onto span{|c)|c S Qnon x 
If "reset with state gj" is measured, the tape head is reset to point to the left end-marker, and 
the machine continues from the superposition |gi,0) in the next step. Note that the decoherence 
associated with this measurement means that the system allows mixed states. 

A 2QFA'^ M is said to recognize a language L with error bounded by e if A^'s computation 
results in "accept" being measured for all members of L with probability at least 1 — e, and "reject" 
being measured for all other inputs with probability at least 1 — e. 

A 2-way quantum finite automaton with restart (2QFA^) is a restricted 2QFA'^ in which the 
"reset moves" can target only the original start state of the machine, that is, in terms of Equation 
[H all the of a 2QFA^ are empty, with the exception of Q'^, represented as Qrestart- 

The two-way probabilistic finite automaton (2PFA) is the classical probabilistic counterpart of 
2KWQFA's; see |Kan91| for the details. A one-way probabilistic finite automaton (IPFA) |Rab63j 
is a 2PFA in which the head moves only to the right in every step. A rational IPFA [Tur69| is a 
IPFA where all entries in the transition matrices are rational numbers. 

Other variants of two-way automata with reset that will be examined in this paper are 

1. A one-way (Kondacs-Watrous) quantum finite automaton with reset (1QFA~^) is a restricted 
2QFA^ which uses neither "move one square to the left" nor "stay put" transitions, and whose 
tape head is therefore classical, 

2. A one-way (Kondacs-Watrous) quantum finite automaton with restart (IQFA^) is a IQFA'^ 
where the reset moves can target only the original start state, and, 

3. A one-way probabilistic finite automaton with restart (IPFA^) is a IPFA which has been en- 
hanced with the capability of resetting the tape head to the left end-marker and swapping to 
the original start state. 

A one-way (Kondacs-Watrous) quantum finite automaton (IKWQFA) [KW97j is a 2KWQFA 
which moves its tape head only to the right in every step. 

A well-known two-way mixed-state model is the 2QCFA |AW02| . Formally, a 2-way finite au- 
tomaton with quantum and classical states (2QCFA) is a 9-tuple 

M = {Q,S,U,Q,6,qo,So,Sacc,Srej), (4) 

where 

1. Q = {go, . . . , qni} is the finite set of the quantum states; 

2. S = {sq, . . . , Snj} is the finite set of the classical states; 

3. and 5 govern the machine's behavior, as described below; 

4. qo Q is the initial quantum state; 

5. So £ S is the initial quantum state; 



6. Sacc C S is the set of classical accepting states; 

7. Srej C 5 is the set of classical rejecting states. 

The functions Q and 5 specify the evolution of the quantum and classical parts of Al, respectively. 
Both functions take the currently scanned symbol a G F and current classical state s G 5" as 
arguments. ©{s,a) is either a unitary transformation, or an orthogonal measurement. In the first 
case, the new classical state and tape head direction (left, right, or stationary) are determined by 
5, depending on s and a. In the second case, when an orthogonal measurement is applied on the 
quantum part, 5 determines the new classical state and the tape head direction using the result of 
that measurement, as well as s and a. The quantum and classical parts are initialized with \qo) and 
So, respectively, and the tape head starts on the first cell of the tape, on which (twS is written for 
a given input string w (z U* . During the computation, if an accepting or rejecting state is entered, 
the machine halts with the relevant response to the input string. 

Note that hke the IQFA"^, and unlike the 2QFA and the 2QFA'^, the tape head position of a 
2QCFA is classical, (that is, there are no superpositions with the head in more than one position 
simultaneously,) meaning that the machine can be implemented using a quantum part of constant 
size. 

2.2 Basic facts 

We start by stating some basic facts concerning automata with restart, which will be used in later 
sections. 

A segment of computation which begins with a (re)start, and ends with a halting or restarting 
configuration will be called a round. Clearly, every automaton with restart which makes nontrivial 
use of its restarting capability will run for infinitely many rounds on some input strings. Throughout 
this paper, we make the assumption that our two-way automata do not contain infinite loops within 
a round, that is, the computation restarts or halts with probability 1 in a finite number steps for 
each round. 

Everywhere in this section, TZ will stand for a finite state automaton with restart, and w £ E* 
will represent an input string using the alphabet E. 

Definition 1. 

• PacciT^iw), PrejiT^jw), and Prestart^iw) denote the probabilities that TZ will accept, reject, or 
restart, respectively, on input w, in the first round. 

• Pacc(^)i^) c-nd Pfe^{TZ,w) denote the overall acceptance and rejection probabilities of w by TZ, 
respectively. 

Moreover, phait{'J^,w) = pacc{T^,w) + Prej 
Lemma 1. 



Proof. 



1 



: PacciTl, W 



1 - (1 - Pacc{T^, W) - PrejiT^, w)) 
Pacc{Ti, w) 



Pacc{T^,w) +Prej(Tl,w) 
1 



Pacc('R-,w) 

Prej {"R-, w) is calculated in the same way. □ 

Lemma 2. The language L (1 XI* is recognized byTZ with error bound e > if and only i/ < 

-p^ when w £ L, and < -p^ when w 4 L. Furthermore, if (^m^) is at most 

e, then Pacc('^)'U^) rejiT^, w)) is at least 1 — e. 

Proof. This follows from Lemma [H since, for allp> 0, e G [0, i), 

1 e , 

> I - e 4^ p < , and (6) 



l+p - " - 1 - e 

P<e^ > 1 - e. (7) 

l+p 

□ 

Lemma 3. Let p = PhaitiJ^^ w), and let s{w) be the maximum number of steps in any branch of a 
round ofTZ on w. The worst-case expected runtime ofTZ on w is 

i(.H). (8) 

Proof. The worst-case expected running time of 7?. on is 

oo 

J2{i + -py{p){s{w)) = {p)isiw))- = -(.H). (9) 

□ 



Lemma 4. Any one-way automaton with restart with expected runtime t can be simulated by a 
corresponding two-way automaton without restart in expected time no more than 2t. 

Proof. The program of the two-way machine (JZ2) is identical to that of the one-way machine with 
restart (TZi), except for the fact that each restart move of TZi is imitated by 7^2 by moving the head 
one square per step all the way to the left end- marker. This causes the runtimes of the i nonhalting 
rounds in the summation in Equation ([9]) in Lemma [3] to increase by a factor of 2. □ 



We will now give a quick review of the technique of probability amplification. Suppose that we 
are given a machine (with or without reset) A, which recognizes a language L with error bounded 
by e, and we wish to construct another machine which recognizes L with a much smaller, but still 
positive, probability of error, say, e . It is well knowE0 that one can achieve this by running A 
0(log(^)) times on the same input, and then giving the majority answer as our verdict about the 
membership of the input string in L. 

Suppose that the original machine A needs to be run 2fc + 1 times for the overall procedure to 
work with the desired correctness probability. Two counters can be used to count the acceptance 
and rejection responses, and the overall computation accepts (rejects) when the number of recorded 
acceptances (rejections) reaches k + 1. To implement these counters in the finite automaton setting, 
we need to "connect" {k + 1)^ copies of A, {Aij | < i, j < k}, where the subscripts indicate the 
values of the two counters, i.e., the states of Aij encode the information that A has accepted i 
times and rejected j times in its previous runs. The new machine Ai is constructed from the Aij 
as follows: 

— The start state of is the start state of .4o,o; 

— Upon reaching any accept state of Aij {0 < i,j < k), Ai moves the head back to the left 
end-marker and then switches to the start state of Ai+ij; 

— Upon reaching any reject states of Aij (0 < i,j < k), M moves the head back to the left 
end-marker and then switches to the start state of Aij+i; 

— The accept states of M. are the accept states of Akj {0 < j < k); 

— The reject states of are the reject states of Ai^k {0 < i < k). 

Lemma 5. // language L C E* is recognized by TZ with a fixed error bound e > 0, then for any 
positive error bound e < e, there exists a finite automaton with reset, TZ , recognizing L . Moreover, 
ifTZ has n states and its (expected) runtime is 0{s{\w\)), then TZ has 0(log^(^)n) states, and its 
(expected) runtime is 0{\og{\)s{\w\)), where w is the input string. 

Proof. Follows easily from the above description. □ 

Finally, we note the following relationship between the computational powers of the 2QCFA and 
the IQFA^. 

Lemma 6. For any IQFA^ Aii with n states and expected runtime t{\w\), there exists a 2QCFA 
M2 with n quantum states, 0{n) classical states, and expected runtime 0{t{\w\)), such that M2 
accepts every input string w with the same probability that Mi accepts w. 

Proof. We utilize the 2QCFA's ability of making arbitrary orthogonal measurements. Given a 
IQFA'^ A^i, we construct a 2QCFA M2 with the same set of quantum states. On each tape 
square, A^2 first performs the unitary transformation associated with the current symbol by the 
program of Mi. It then makes a measurement (over the space spanned by the set of quantum 
states) using an observable O , which is formed by replacing each subspace of the form E^eset-i in 
the observable O (Equation [3]) of Jl by its subspaces 

{-^reset— i— (jij^ © Preset— i—qi^ ® • • • ® -£/j.eset— i— } ; 
^ See, for instance, pages 369-370 of [Sip06| . 

^ Since the head is classical, the observable is redefined to be a decomposition of the space spanned by just the set 
of states. 



where {g^i, g^a, • • • ,qim} = and Ereset-i-qt^ = span{\qi.)} . The outcome associated with 

Ereset-i-qi . is simply the name of qi^ . 

ta^es the action specified below according to the result of this observation: 

1. "continue without resetting": move the head one square to the right, 

2. "accept": accept, 

3. "reject": reject, 

4. "qij"- enter a classical state that moves the head left until the left end-marker $ is seen, and 
perform a unitary transformation that transforms the quantum register from state qij to qi. 

□ 



3 Computational power of IQFA^'s 

In this section, we focus on the IQFA^, which turns out to be the simplest and most restricted 
known model of quantum computation that is strictly superior in terms of bounded-error language 
recognition to its classical counterpart. 

Our first result shows that lQFA"-"s can simulate any IPFA^ with small state cost, albeit 
with great slowdown. Note that no such relation is known between the 2KWQFA and its classical 
counterpart, the 2PFA. 

Theorem 1. Any language L Q U* recognized by an n-state IPFA^ with error hound e can be 
recognized by a 2n + 4-state IQFA^ with the same error bound. Moreover, if the expected runtime of 
the IPFA^ is 0{s{\w\)), then the expected runtime of the IQFA^ is O{0'"\s'^{\w\)) for a constant 
I > 1 depending on n, where w is the input string. 

Proof. Let V be an n-state IPFA^ recognizing L with error bound e. We will construct a 2?i-|-4-state 
IQFA^ M recognizing the same language with error bound e < e. 

By adding two more states, Sacc and Srej, to we obtain a new IPFA^, V , where the halting 
of the computation in each round is postponed to the last symbol, $, on which the overall accepting 
and rejecting probabilities are summed up into Sacc and Srej-, respectively. Therefore, for any given 
input string w G Z"*, the value of Sacc and Srej are Pacd'Pj'w) and preji'Pjw), respectively, at the 
end of the first round. 

By using the method described in |YS09b] , each stochastic matrix can be converted to a unitary 
one with twice the size as shown in the template 



U 



D 



where A is the original stochastic matrix; the columns of B, corresponding to newly added states, 
are filled in to ensure that each row of {A \ B) is pairwise orthogonal to the others, and has the 
same length which depends only on the dimension of A, and the entries of D are then selected to 
make U a unitary matrix. 

Each transition matrix of V can be converted to a (2n + 4) x (2n -I- 4)-dimensional unitary 
matrix according to this template. These are the transition matrices of M. The state set of M can 
be specified as follows: 

1. The states corresponding to Sacc and Srej are the accepting and rejecting states, qacc and qrej, 
respectively. 



2. the states corresponding to the non-halting and non-restarting states of V are non-halting and 
non-restarting states, and, 

3. all remaining states are restarting states. 

The initial state of ^A is the state corresponding to the initial state of V. 

When M runs on input string \ w\, the amplitudes of qacc and Qrej, the only halting states of A^, 

at the end of the first round are {j)^^'^^'^ PacdV ,w) and {j)^^^^"^ prejiV ^w)^ respectively. Therefore, 
when w £ L, 



e2 



and similarly, when w ^ L, 



Prej{M,w) ^ Prej{'P,w) ^ 

Pacc{M,w) ~ pI^^{V,w) - (1-e) 



Pacc{M,w) pI^^{V,w) ^ e2 



2 ■ 



By solving the equation 



we obtain 



1-e' (l-e)2' 



e2 



l-2€ + 2e2 



< e. 



The expected runtime of V is 



^ GO(.(H)), 



Pacc{'P,w) +Prej{'P,w) 

and so the expected runtime of M is 

□ 

Corollary 1. IQFA'^'s can recognize all regular languages with zero error. 

To establish the strict superiority of IQFA^'s over IPFA^'s, we will make use of the following 
concepts. 

An automaton M is said to recognize a language L with positive one-sided unbounded error if 
every input string w £ L is accepted by M. with nonzero probability, and every w ^ L is rejected by 
Ai with probability 1. An automaton A4 is said to recognize a language L with negative one-sided 
unbounded error if every input string it; € L is accepted by M with probability 1, and every w ^ L 
is rejected by M with nonzero probability. 

For an automaton Ai recognizing a language L, we define the gap function, g_M : ^ [0, 1], 
such that gM (^) is the difference between the minimum acceptance probability of a member of L 
with length at most n and the maximum acceptance probability of a non-member of L with length 
at most 



The definition of qm is due to Bertoni and Carpentieri |BC01) . who call it the "error function.' 



Lemma 7. // a language L is recognized by a IKWQFA A4 with positive (negative) one-sided 
unbounded error such that fl'x(n) > c"" for some c > 1, then for all e G (0, L is recognized by 
some IQFA^ having three more states than M. with positive (negative) one-sided error e in expected 
time 0{^c\'"\\w\). 

Proof. We consider the case of positive one-sided error. The adaptation to the other case is trivial. 
A4 is converted into a IQFA^ as fohows. starts by branching to two equiprobable paths, 
pathi and path2, at the beginning of the computation, pathi imitates the computation of A^, except 
that all reject states that appear in its subpaths are replaced by restart states. Regardless of the 
form of the input, path2 moves right with amplitude (and so restarts the computation with 
the remaining probability,) on every input symbol. When it arrives at the right end-marker, path2 
rejects with amplitude y/e, and restarts the computation with amplitude \/l — e. 
When w ^ L, 

Pacc{M[,w) = 0, and Prej{M'^,w) = 
and so the input is rejected with probability 1. When w G L, 

Pacc{M'^,w) > andprej{M'„w) = 

and so the input is accepted with error bound e > due to Lemma El since 

Pacc{M'^,w) ~ 

Since Phaiti-M'^,w) is always greater than the expected runtime of M'^ is 0(icl'"l|t(;|). □ 

Lemma 8. If a language L is recognized by a IKWQFA M with positive (negative) one-sided 
bounded error such that ^^^(n.) > c~^ for some c > 1, then for all e G (0, L is recognized by some 
IQFA'-^ having three more states than Ai with positive (negative) one-sided error e in expected time 
0{lc\w\). 

Proof. The construction is almost identical to that in Lemma [TJ except that path2 rejects with 
amplitude ^/€, and restarts the computation with amplitude \/l — e immediately on the left end- 
marker, thereby causing every input to be rejected with the constant probability ^. Hence, the 
expected runtime oi M.'^ turns out to be 0(ic|t(;|). □ 

Lemma [7] is a useful step towards an eventual characterization of the class of languages that 
are recognized with one-sided bounded error by IQFA^'s, since full classical characterizations are 
known |YS09cj for the classes of languages recognized by one-sided unbounded error by several 
IQFA models, including the IKWQFA. 

A language L is said to belong to the class |Tur69|Mac93] if there exists a rational IPFA 
that accepts all and only the members of L with probability ^. 

Theorem 2. For every language L G S^at> there exists a number n such that for all error bounds 
e > 0, there exist n-state IQFA^'s that recognize L and L with one-sided error bounded by e. 



Proof. For a language L in S^^^, let 1^ be the rational IPFA associated, by L as described above. 
Turakainen [Tur69j showed that there exists a constant b > 1 such that for any string w ^ L, the 
probability that V accepts w cannot be in the interval (^ — 6~ '"'1,^ + 6" I*"'). By using the method 
described in |YS09cj . we can convert V to a IKWQFA M recognizing L with one-sided unbounded 
error, so that A4 accepts any w G L with probability greater than c"'"'', for a constant c > b. We 
can conclude with Lemma [71 □ 

S^^j contains many well-known languages, such as, L^g, Lpai = {w \ w = w^}, Ltwm = {wcw \ 
w E {a, 6}*}, Lmult = {x#y#z \ x,y,z are natural numbers in binary notation and x x y = z}, 
Lsquare = {ci^'b"' | n > 0}, Lpower = {cL^'b'^ }, and all polynomial languages, |Tur82j defined as 

• • • a;j'^5f • • • e^"^'- '"^^ I Pi(ni, • • • , nfc) > 0}, 

where ai, • • • , a^, 61, • • • , 6^ are distinct symbols, and each pi is a polynomial with integer coefficients. 
Note that Theorem [2] and Lemma O answer a question posed by Ambainis and Watrous |AW02j 
about whether Lgquare and Lpower can be recognized with bounded error by 2QCFA's affirmatively. 



Corollary 2. The class of languages recognized by IQFA^'s with bounded error properly contains 
the class of languages recognized by IPFA^ 's. 

Proof. This follows from Theorems [1] and [21 Lemma [H and the fact |DS92j that Lpai cannot be 
recognized with bounded error by 2PFA's. □ 

Since general IQFA's are known to be equivalent in language recognition power to IPFA's, one 
has to consider a two-way model to demonstrate the superiority of quantum computers over classical 
ones. The 2QCFA is known [AW02j to be superior to its classical counterpart, the 2PFA, also by 
virtue of Lpai- Recall that, by LemmalU 2QCFA's can simulate IQFA^'s easily, and we do not know 
of a simulation in the other direction. 



4 Conciseness of 2QFA's with mixed states and 2PFA's 

In this section, we demonstrate several infinite families of regular languages which can be recognized 
with some fixed probability greater than ^ by just tuning the transition amplitudes of a IQFA^ with 
a constant number of states, whereas the sizes of the corresponding IQFA's, IPFA's, and 2NFA's 
grow without bound. One of our constructions can be adapted easily to show that IPFA^'s, (and, 
equivalently, 2PFA's), also possess the same advantage over those machines. 

Definition 2. For an alphabet S containing symbol a, and m G Z"*", the family of languages Am is 
defined as 

■^m = {ua I u G Z"*, \u\ < m}. 

Note that Ambainis et al. [ANTSV02j report that any Nayak one-way quantum finite automatoE0 
that recognizes A^ with some fixed probability greater than ^ has 2^^™) states. 



* This is a IQFA model of intermediate power, subsuming the IKWQFA, but strictly weaker than the most general 
models ( [PasOOICiaOT] . and one-way versions of 2QCFA's,) which recognize any regular language with at most the 
same state cost as the corresponding DFA. 



Theorem 3. A^^ is recognized by a 6-state IQFA^ ■M.m.e for any error hound e > 0. Moreover, the 
expected runtime of Mrn,e on input w is I^D- 

Proof Let Mm,e = {Q, ^, S, go, Qacc, Q re j,Q restart] be a IQFA^ with Qnon = {QO, Ql} , Qacc = {A}, 

Qrej = {R}^ Qrestart = {-^15-^2}- ■Mm.,t Contains the transitions 



ko) = eki) + \R) + y/l^7^^^^\h) 
Uako) = e\qo) + ^\-e^\h) + ^1/2) 

Uaki) = eko) + ^\-e^\h) - ^1/2) 

Ui:\wko) = eki) + + -^1/2) 



U$ko) = \A) 
y}%\qi) = \R) 



and the transitions not mentioned above can be completed easily, by extending each Uo- to be 
unitary. 

On the left end-marker, M.m,t rejects with probability e^m+s^ goes on to scan the input string 
with amplitude e, and restarts immediately with the remaining probability. States go and qi imple- 
ment the check for the regular expression 17* a, but the machine restarts with probability 1 — on 
all input symbols during this check. 

liw = ua for u G 17*, and cj 7^ a, the input is rejected with probability 1, since Pacc{-M.m,t,w) = 

0. 

If u; = na for u £ U* , 



Hence, if u; G 
and if ^ Am , 



Pacc{Mm,e,w) =£2^1+2^ Prej{Mm,e,w) 



g2m+5 



Pace 



2m+6 



In both cases, the corresponding ratio /"t^'"'"'"!! or ^'""'^''^"^'^'TI is not greater than e. Thus, by 
Lemma [21 we conclude that M.m,e recognizes Am with error bounded by e. Since Phaiti-Mm,e,w) is 
always greater than e2m+5^ expected runtime of A4m,e is 0{[^) \w\). □ 

By a theorem of Rabin |Rab63j . for any fixed error bound, if a language L is recognized with 
bounded error by a IPFA with n states, then there exists a deterministic finite automaton (DFA) 
that recognizes L with 2<^(") states. Parallelly, Freivalds et al. |FQM09| note that one-way quantum 
finite automata with mixed states are no more than superexponentially more concise than DFA's. 
These facts can be used to conclude that a collection of IPFA's (or IQFA's) with a fixed common 



number of states that recognize an infinite family of languages with a fixed common error bound 
less than ^, d la the two-way quantum automata of Theorem [3l cannot exist, since that would imply 
the existence of a similar family of DFA's of fixed size. By the same reasoning, the existence of such 
families of 2NFA's can also be overruled. 

The reader should note that there exists a bounded-error IPFAO (and therefore, a 2PFA|,) for 
Am, which one can obtain simply by replacing each transition amplitude of IQFA^ A^m,e defined 
in Theorem [3] by the square of its modulus. This establishes the fact that 2PFA's also possess the 
succinctness advantage discussed above over IPFA's, IQFA's and 2NFA's. 

We proceed to present two more examples. 

Definition 3. For m £ the language family Bm ^ {a}* is defined as 

Bm = {fi* I "i mod (m) = 0}. 

Theorem 4. For any error hound e > 0, there exists a 7-state IQFA^ ■Mm,e which accepts any 
w G Bm with certainty, and rejects any w ^ Bm with probability at least 1 — e. Moreover, the expected 
runtime of Aim.e on w is O sin~^(^)|t(;|) . 

Proof. We will construct a 4-state IKWQFA recognizing Bm with positive one-sided unbounded 
error, as described in |AF98j . Let Mm = {Q, ^, qo, Qacc, Qrej) be IKWQFA with Qnon = {qo, qi}, 
Qacc = {A}, Qrej = {R}- Mm Contains the transitions 

Uako) 
Uakl) 

u$ko) 
u$ki) 

and the transition amplitudes not listed above are filled in to satisfy unitarity. Mm begins compu- 
tation at the |go)-axis, and performs a rotation by angle — in the |'?o)-|'?i) plane for each a it reads. 
Therefore, the value of the gap function, gMm^ is not less than sin^(^) for > 0. By Lemma 
El there exists a 7-state IQFA^ M m,e recognizing Bm with positive one-sided bounded error and 
whose expected runtime is O (^ sin~^(^)|t(;|) . By swapping the accepting and rejecting states of 
■Mm,e, we can get the desired machine. □ 

Definition 4. For an alphabet U, and m G Z^, the language family Cm is defined as 

Cm = {w £ U* \ \w\ = m}. 

Theorem 5. For any error bound e > 0, there exists a 7-state IQFA^ Mm,e which accepts any 
w £ Cm with certainty, and rejects any w ^ Cm with probability at least 1 — e. Moreover, the expected 
runtime of Mm,e on w is 0{^2"^\w\). 



\Qo) 

cos(— )|go) +sin(— 
m m 

TT TT 

-sin(— )|go) + cos( — 
m m 



\R) 



^ See Section|6]for an examination of the relationship between the computational powers of the IPFA^ and the 2PFA. 



Proof. We will contruct a 4-state IKWQFA recognizing Cm with positive one-sided unbounded 

error. Let Mm = (Q, go, QaccQrej) be IKWQFA with Qnon = {qO,qi}, Qacc = {^}, Qrej = 

{R}- Mm contains the transitions 




U<TGi:ko) = "^l^o) + -^\^) 
[J^\q,) = ±\A) + ^\R) 

with the amplitudes of the transitions not mentioned above filled in to ensure unitarity. 

Mm encodes the length of the input string in the amplitude of state go, which equals ( j 
just before the processing of the right end-marker. The desired length m is "hardwired" into the 
amplitudes of gi . For a given input string w £ U* , ii w G Cm , then the amplitudes of states qo and 
qi are equal, and the quantum Fourier transform (QFT) [KW97j performed on the right end-marker 
sets the amplitude of ^4 to 0. Therefore, w is rejected with certainty. If w £ Cm, then the accepting 
probability is equal to 

\w\+2 / I \ "*+2^ 




^2, 

and it is minimized when |tt;| = m + 1, which gives us the inequality 

-j^ \ m+6 



By Lemma [HI there exists a 7-state IQFA^ Mm,e recognizing Cm with positive one-sided bounded 
error and whose expected runtime is O [^2^\w\). By swapping the accepting and rejecting states 
ofM m.e, we can get the desired machine. Q 

Note that, unlike what we had with Theorem O the QFA's of Theorems H] and [5] cannot be 
converted so easily to 2PFA's. In fact, we can prove that there exist no 2PFA families of fixed size 
which recognize Bm and Cm with fixed one-sided error less than ^, like those QFA's: Assume that 
such a 2PFA family exists. Switch the accept and reject states to obtain a family for the complements 
of the languages. The 2PFA's thus obtained operate with cutpoint 0. Obtain an equivalent 2NFA 
with the same number of states by converting all transitions with nonzero weight to nondeterministic 
transitions. But there are only finitely many 2NFA's of this size, meaning that they cannot recognize 
our infinite family of languages. 

5 Efficient Probability Amplification 



Many automaton descriptions in this paper, and elsewhere in the theory of probabilistic and quan- 
tum automata, describe not a single algorithm, but a general template which one can use for 



building a machine that operates with a desired error bound e. The dependences of the runtime 
and number of states of on ^ are measures of the complexity of the probability amplification 
process involved in the construction method used. Viewed as such, the constructions described in 
the theorems in Section U] are maximally efficient in terms of the state cost, with no dependence on 
the error bound. In this section, we present improvements over previous results about the efficiency 
of probability amplification in 2QFA's. 



5.1 Improved algorithms for L 



eq 



In classical computation, one only needs to sequence 0(log(i)) identical copies of a given prob- 
abilistic automaton with one sided error p < 1 to run on the same input in order to obtain a 
machine with error bound e. Yakaryilmaz and Say [YS09a] noted that this method of probability 
amplification does not yield efficient results for 2KWQFA's; the number of machine copies required 
to reduce the error to e can be as high as (-)^. The most succinct 2KWQFA's for Lgg produced 
by alternative methods developed in |YS09aj have 0(log^(^) loglog(i)) states, and runtime linear 
in the size of the input w. In Appendix we present a construction which yields (exponential 
time) IQFA^'s that recognize Leg within any desired error bound e, with no dependence of the 
state set size on e. Ambainis and Watrous |AW02j present a method which can be used to build 
2QCFA's that recognize L^q also with constant state set size, where the "tuning" of the automaton 
for a particular error bound is achieved by setting some transition amplitudes appropriately, and 
the expected runtime of those machines is 0(|i(;|^). We now show that the 2QFA^ formalism allows 
more efficient probability amplification. 

Theorem 6. There exists a constant n, such that, for any e > 0, an n-state 2QFA^ which recognizes 
Leg with one-sided error bound e within 0{^\w\) expected runtime can be constructed, where w is 
the input string. 

Proof. We start with Kondacs and Watrous' original 2KWQFA |KW97j Mjy, which recognizes Leq 
with one-sided error for any integer > 1. After a deterministic test for membership of a*b*, Mj^ 
branches to computational paths, each of which perform a QFT at the end of the computation. 
Set N = 2. M2 accepts all members of L^q with probability 1. Non-members of L^g are rejected 
with probability at least |. We convert M2 to a 2QFA^ A4^ by changing the target states of the 
QFT as follows: 

pathi -^iReject) + ^^lAccept) -|- y''^^^-^! Restart) 



patha — -^iReject) -I- ^J ^|Accept) -I- y Rest art) 

where the amplitude of each path is A=. For a given input w £ E*, 

V 2 

1. if w is not of the form a*b*, then p,.ej(A^^, w) = 1; 

2. if w is of the form a*b* and w ^ L, then prej{.M^,w) = |, and Pacci-Me^'^) — f ! 

3. if w £ L, then prejiM^^ w) = and Pacc(-A^ei w) = e. 

It is easily seen that the error is one-sided. Since = g -^^e can conclude with Lemma [2l 

Moreover, the minimum halting probability occurs in the third case above, and so the expected 
runtime of Ai^ is 0(-|t(;|). □ 



Theorem 7. For any e € (0, there exists a 2QFA^ with 0(log(i)) states that recognizes Leq 
with one-sided error bound e in 0(log(^)|w;|) steps, where w is the input string. 

Proof. Let M2 be the 2KWQFA recognizing L^q with one-sided error bound ^ mentioned in the 
proof of TheoremlH Then, a 2QFA'^ that is constructed by sequentially connecting 0(log(^)) copies 
of M2, so that the input is accepted only if it is accepted by all the copies, and rejected otherwise, 
can recognize L^g with one-sided error bound e. □ 



5.2 An improved algorithm for Lpai 

Ambainis and Watrous |AW02j present a 2QCFA construction which decides Lpai in expected time 

0((i)l"Vl) with error bounded by e > 0, where w is the input string. (Watrous |Wat98j describes 
a 2KWQFA which accepts all members of the complement of Lpai with probability 1, and fails to 
halt for all palindromes; it is not known if 2KWQFA's can recognize this language by halting for 
all inputs.) We will now present a IQFA^ construction, which, by Lemma [6l can be adapted to 
yield 2QCFA's with the same complexity, which reduces the dependence of the Ambainis- Watrous 
method on the desired error bound considerably. 

Theorem 8. For any e > 0, there exists a 15-state IQFA^ M.^ which accepts any w E Lpai with 
certainty, and rejects any w ^ Lpai with probability at least 1 — e. Moreover, the expected runtime 
of Me on w is 0{\3\'"\\w\). 

Proof. We will first construct a modified version of the IKWQFA algorithm of Lace et al. |LSDF09] 
for recognizing the nonpalindrome language. The idea behind the construction is that we encode 
both the input string and its reverse into the amplitudes of two of the states of the machine, and 
then perform a substraction between these amplitudes using the QFT |LSDF09] . If the input is not 
a palindrome, the two amplitudes do not cancel each other completely, and the nonzero difference 
is transferred to an accept state. Otherwise, the accepting probability will be zero. 

Let M = {Q,E,6,qo,Qacc,Qrej) be IKWQFA with Qnon = {pi,P2, Qo, 9i, 92, 93} , Qacc = {A}, 
Qrej = {Ri I 1 < ^ < 5}. The transition function of M is shown in Figure [H As before, we assume 
that the transitions not specified in the figure are filled in to ensure that the Do- are unitary. 

path2 and pathi encode the input string and its reverse |Rab63|Paz71j into the amplitudes of 
states q2 and p2, respectively. If the input is w = W1W2 ■ ■ -wi, then the values of these amplitudes 
just before the transition associated with the right end-marker in the first round are as follows: 

/ rz\ hi 

— State p2 has amplitude ( w | j {O.wiWi-i • • • wi)2, and 

-\ H 



state q2 has amplitude y 3 ) {O.W1W2 ■ ■ ■ wi)2- 



The factor of y | is due to the "loss" of amplitude necessitated by the fact that the originally non- 
unitary encoding matrices of |Rab63|Paz71j have to be "embedded" in a unitary matrix [YS09bj . 
Note that the symbols a and b are encoded by and 1, respectively. 

If w € Lpau the acceptance probability is zero. If if G Lpau the acceptance probability is 
minimized by strings which are almost palindromes, except for a single defect in the middle, that 
is, when \w\ = 2k for k S Z"*", Wi = W2k-i+i, where 1 < i < k — 1, and 7^ w^+i, so, 

1 I""! 
9MH>-i- 



Fig. 1. Specification of the transition function of Ai 
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Usbi> = \Ri) 


path2 


Usigi) = \Rz) 

U,\q2)^-^^\A) + j.\R,) 

Us|g3) = [Ri) 



By Lemma [71 there exists a 15-state IQFA^ A4e recognizing Lpai with positive one-sided bounded 
error, whose expected runtime is 0(i3l"'l|'u;|). By swapping accepting and rejecting states of A^m, 
we can get the desired machine. □ 

Note that the technique used in the proof above can be extended easily to handle bigger input 
alphabets by using the matrices defined on Page 169 of |Paz71| . and the method of simulating 
stochastic matrices by unitary matrices described in |YS09bj . 

6 IPFA^ vs. 2PFA 

It is interesting to examine the power of the restart move in classical computation as well. Any 
IPFA^ which runs in expected t steps can be simulated by a 2PFA which runs in expected 2t 
steps (see Lemma H]) . We ask in this section whether the restart move can substitute the "left" 
and "stationary" moves of a 2PFA without loss of computational power. Since every polynomial- 
time 2PFA recognizes a regular language, which can of course be recognized by using only "right" 
moves, we focus on the best-known example of a nonregular language that can be recognized by an 
exponential-time 2PFA. 

Theorem 9. There exists a natural number k, such that for any e > 0, there exists a k-state IPFA^ 
Ve recognizing language L^g with error bound e and expected runtime 0((^)'"''|u^|), where w is the 
input string. 

Proof. We will construct the IPFA^ Ve as follows: Let x = y- The computation splits into three 
paths called pathi, path2, and paths with equal probabilities on symbol All three paths, while 
performing their main tasks, parallelly check whether the input is of the form a*b* , if not, all paths 
simply reject. The main tasks of the paths are as follows: 



• pathi moves on with probability x and restarts with probabihty 1 — x when reading symbols a 
and b. After reading the right end-marker $, it accepts with probability with 1. 

• path2 moves on with probability and restarts with probability 1 — when reading symbol 
a. On 6's, it continues with the "syntax" check. After reading the $, it rejects with probability 
I and restarts with probability 1 — f • 

• paths is similar to path2, except that the transitions of symbols a and h are interchanged. 

If the input is of the form a"^b^, then the accept and reject probabilities of the first round are 
calculated as 

Pacc{re,w) = and Prej{V,,w) = ^ (x^^ + X^") . 

If m = n, then 

Prej{Ve,w) 



e. 



Pacc{'Pe,w) 

If m 7^ n (assume without loss of generality that m = n + d for some d G Z+) , then 

Pacc{Ve,w) 2 x2"+'i 2 X^ / 2 . 2 

— — < -X < -X 



e2 



By replacing x = — , we can get 



Prej {'Pe,w) 6 x2"+2rf + e x2'^ + 1 e ' 

PaccCPe^w) 



< e. 



Prej{Ve,w) 

By using Lemma El we can conclude that Ve recognizes Leg with error bound e. 
Since phait{'Pe,w) is always greater than ixl""!, the expected runtime of the algorithm is 0((^)l"'l ju;! 
where w is the input string. □ 



7 Concluding remarks 

By a theorem of Dwork and Stockmeyer |DS90] . for a fixed e < ^, if L is recognized by a 0(n)-time 
2PFA with c states within error probability e, then L is also recognized by a DFA with c^'^^ states, 
where the number b depends on the constant hidden in the big-O. The two-way machines of Section 
[Hcan be seen to have such factors that grow with m in the expressions for their time complexities; 
this is how the machines described in that section achieve their huge superiority in terms of the 
state cost over the other models that they are compared with. 

It is known |YS09bj that 2KWQFA's can recognize some nonstochastic languages (i.e. those 
which cannot be recognized by 2PFA's) in the unbounded error setting. On the other hand, we 
conjecture that 2QFA's with classical head position, such as the 2QCFA, cannot recognize any non- 
stochastic language. Therefore, it is an interesting question whether 2QFA'^'s (or possibly an even 
more general 2QFA model allowing head superposition) can recognize any nonstochastic language 
with bounded error or not. 

Some other open questions related to this work are: 

1. Can IQFA^'s simulate 2QCFA's? 

2. Are IPFA^'s (with just "restart" and "right" moves) equivalent in power to 2PFA's in the 
bounded-error setting, as hinted by Section [6p 

3. Does there exist an analogue of the Dwork-Stockmeyer theorem mentioned above for two-way 
quantum finite automata? 
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A A IQFA^ algorithm for Leg 

Theorem 10. For any e > 0, there exists a 15-state IQFA^ Me, which accepts any w G L^q with 
certainty, and rejects any w ^ Lg^ with probability at least 1 — e. Moreover, the expected runtime of 
Me on w is 0{^{2V2)\'"\\w\) . 

Proof. We will contruct a 12-state IKWQFA recognizing L^q with positive one-sided unbounded 
error. Let M = {Q, U,6,qo,Qacc,Qrej) be IKWQFA with Qnon = {po,Pi,P2,qo,qi,q2} , Qacc = 
{Ai, A2, A-s}, Qrej = {Ri, R21 Rs}- The transition function of M. is shown in Figure[2l As before, we 
assume that the transitions not specified in the figure are filled in to ensure that the Ug- are unitary. 



Fig. 2. Specification of the transition function of A4 
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As seen in the figure, A4 branches to two paths on the left end-marker. All paths rejects imme- 
diately if the input w E {a,b}* is the empty string, and accepts with nonzero probability, say a, if 
it is of the form ({a, b}* \ a*6*) U a"^ U Otherwise, w = a"^b^ (m, n > 0), and the amplitudes of 
the paths just before the transition associated with the right end-marker in the first round are as 
follows: 

- State p2 has amplitude 75 (5)™ (75)'^, 

- state q2 has amplitude 



If m = n, then the accepting probabihty is zero, lim ^ n (assume that m = n + d for some d E Z+), 
then the accepting probabihty is equal to 




Since a is always greater than this value, 

gMiH) > (^) ' ' 

for \w\ > 0. By Lemma [71 there exists a 15-state IQFA^ Ai^ recognizing Lgg with positive one- 
sided bounded error and whose expected runtime is 0(i(2\/2)l"'l|u'|). By swapping accepting and 
rejecting states of Aim, we can get the desired machine. □ 



